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(54) Gyllethod and) apparatus for pmcessllng a bliltstresm 


(57) Apparatus (100. 700) for processing a com- 
pressed input bitstream (112. 712) representing an 
information signal. The apparatus processes the com- 
pressed input t}itsti'eam in a ¥vay that chcmges the infor- 
mation signal represented by the compressed input 
bitstream, arKi comprises a layered decoder (114, 
714A) that decodes the compressed input t»tstream to 
provide a decoded bitstream (116. 716A}. a decoded 
bitstream processor (118. 718A) that processes the 
decoded bitstream to provide a modified bitstream (122. 
722A). a layered encoder (124. 724) that re-encodes 
the modHied bitstream to provide a compressed output 
bitstream (126. 726). and a selective interconnection 
path (134, 215. 315. 138; 725. 721, 719. 738). The lay- 
ered decoder includes serially<onnected decoding 
modules (e g.. 201, 203. 705, 707). Ihe decoded bit- 
stream processor processes the decoded bitstream in a 
way that n^sdifies the information signal. The layered 
encoder includes serially-connected encoding modules 
(e.g.. 301. 303. 705, 707), each of which conesponds to 
one of the decoding nv)dules in the layered decoder. 
The selective interconnection path selectively connects 
the output of one of the decoding modules to the Input 
of the decoded bitstream processor and selectively con- 
nects the output of the decoded t^tstream processw to 
the input of the one of the encoding modules corre- 
sponding to the one of the decoding modules. The lay- 
ered decoder may include an element ttiat derives 
brtstream parameters from the compressed input bit- 
stream, and the apparatus may additionally comprise a 
bitstream parameter fon^rarding path that interconnects 
the layered decoder to the layered encoder. At least one 
of the encotfing nnodules may be connected to the 


parameter fbnvaniing path and may peiform an encod- 
ing operation using the bitstream parameters derived 
from the compressed input t>itstream. 
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Descflptlon 

Reld of the Invention 

The invention relates to processing bHstreams, and, 
in particular, to processing compressed tHtstreams in a 
way that reduces the resources required to pertorm the 
processing. 

BacStground of the Invention 

Brtstreans representing information signals are 
often sut)ject to compression to conserve communica- 
tions bandwidth or signal storage requirementa For 
example, the bandwidth or signal storage required to 
transmit or store a video bitstream representing a 
nation picture can be reduced by a factor of the order of 
100 by applying suitable spatial and temporal compres- 
sion. Such spatial ard temporal compression schemes 
include the MPEG-1 and MPEGh2 schemes standard- 
ized by the ISO. 

Production, distribution and displ^ of video bit- 
streams representing video signals often involves 
processing the video bitstream in some way. Such 
processing may motfify the video signal represented by 
the video bitstream. For example, the processing may 
apply cdor correction or a different gamma correction, 
or may apply no^e reduction to the video signal. Such 
processing may ^itionally or alternatively be per- 
formed to convert the video signal from one video 
standard to another. In this, the number of picture ele- 
ments (pixels) in each picture may be changol. and the 
picture rate may additionally or alternately be 
changed. Moreorer, when the video bitstream is conv 
pressed, tiie processing may also rrrodify the bitstream 
characteristics of the compressed video bitstream. For 
example, the compressed video bitstream may be proc- 
essed to change its bit rate, or to restructure it so that it 
can be decoded using a decoder having a decoder 
buffer of a different siza 

An example of a conventional apparatus 10 for 
processing a compressed input bitstream is shown in 
Figure 1. In this example, the compressed input bit- 
stream is an MPEQ-conpliant video bitstream. Similar 
arrangements may be used for processing video bit- 
streams compressed accoiding to other standards. In 
the conventional apparahis 10 shown In Figure 1, the 
MPEG decoder 14 decodes the compressed input t>it- 
stream 12 to recover the video bitstream 16. The video 
processor 18 applies the processing d^ined by the 
processing selection biock 20 to the video bitstream 16 
to generate the modified video bitstream 22. The modi- 
fied video bitstream is fed to the MPEG encoder 24 that 
generates the compressed output bitstream 26 t>y reen- 
coding the modified video bitstream to have bitstream 
cfiaracteristics, such as bit rate, buffer size, etc., defined 
by the processing selection block 20. The k>rt5tream 
characteristics of the compressed output bitstream may 
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be the same as, or different from, those of the com- 
pressed input bitstream 12. If the processing selected 
by the processing selection block only involves chang- 
ing the bitstream chara^eri^cs. the video processor 1 8 

5 simply passes the video bitstream 16 to the MPEG 
ermder 24 without nmdrfying it. 

The encoding operation performed by the MPEG 
encoder 24 on the modified video bitstream 22 is con- 
sideratdy more computationalty intensive ttian the 

w decoding operation performed by the MPEG decoder 
1 4 on the conrpressed inpiA bitstream 12. For example, 
to encode a video bitstream representing an f^SC 
video signal in real time requires special hardmre or a 
computer based on a miaoprocessor of equivalent 

IS computing power to a 686-type microprocessor. Conse- 
quentty, the conventional apparatus 10 is complex and 
expensiva 

Of the operations performed t^y the MPEG encoder 
24. the motion estination op^ation used to det&'rnne 

£0 the wtidon vector for each block is computationally the 
most intensive. The nuni)er of operations required to 
perform motion estimation can be scaled down by 
reducing the scope of the motion search re^on, or 
using a fast motion search algorithm, but both of these 

2S approaches inevitably impair video quality. To ensure an 
acceptable video quality, the MPEG encoder 24 will 
encode most sequences using relatively large search 
regions with an efnderrt. but suboptimal, motion estima- 
tion algorithm rujtwtthstartding the large computational 

30 resources tiiat this appr(»ch demaruls. 

What is needed is the ability to perform the above- 
mentioned processing on compressed input bitstreams 
witiiout the need for special hardware, or using a oono- 
puter based on a kywer-cost microprocessor. What is 

55 also needed is the ability to perform the at)ove-men- 
tioned processing on compressed input bitstreams 
faster than in real time using cunentiy-available hard- 
ware 

In video production and distrSxition environments. 

40 the video bitstream may be sutiject to a number of differ- 
ent processing operations. Multiple processing opera- 
tions are conventionally applied to the video bitstream 
t>y concatenating a number of processors. Each proces- 
sor operates on the conventional, pixel-level, video bit- 

45 stream generated by the preceding processor. Such an 
arrangement of concatenated processors would replace 
the video processor 18 shown in Rgure 1. 

Using a concatenated anrangement of processors 
to perform multiple processing operations on a video 

50 l>ftstream normally requires that the video bitstream 
operated on by each processor be a corrventional video 
bitstream. Processors that operate on compressed or 
partially-compressed video bitstreams cannot t>e con- 
catenated with processors that operate on conventional 

55 video bitstreants or with processors that operate on 
video bitstreams that are differently compressed. More- 
over, processors that are designed to operate on a con- 
ventional video bitstream, i.e., on an uncompressed 
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video brtstream. require that computational resources 
be expended to decode the compressed input bHstream 
fully before processing, and to fulty re-encode the mod- 
ified bftstream genmled by the processors. FinaOy, 
processing systems that precede the processors by a 5 
conventional decoder and fdlow the processors with a 
conventionaJ encoder require the conpressed input bit- 
stream to be compressed according to the compression 
standard of the decoder, and provide the output bit- 
stream compressed aocorcftng to the oorrpresston 10 
standard of the encoder. 

Accordir>gty. what is atso needed is a video 
processing system that allows processors that operate 
on bitstreams in different states of compression to be 
concatenated, that can process a compressed input bit- is 
stream in any state of conrpression and that can gener- 
ate a compressed output bftstream in a state of 
compression tfiat is greater tfian. less than, or the same 
as that of the compressed irput brtstream. 

20 

Summary of the Invention 

The invention provides an apparatus tor processing 
a compressed input bitstream representing an informa- 
tion signal such as a video signal. The apparatus proc- 2s 
esses the conpressed input bhstream in a way that 
changes the infonnation signal represented tsy the com- 
pressed input brtstream. The apparatus comprises a 
layered decoder that decodes the conpressed input bit- 
stream to provide a decoded bftstream, a decoded bit- 30 
stream processor that processes the decoded brtstream 
to provide a modified bitstream, a layered encoder that 
re-encodes, the modified brtstream to provide a com- 
pressed output brt^eanx and a selective interconnec- 
tion path. The layered decoder includes serially- ss 
connected decoding modules. The decoded bitstream 
processor processes the decoded bitstream in a way 
that modifies the information signal. The layered 
encoder includes &eriaIly<onnected encoding nxxfules, 
each of which corresponds to one of the decoding nrvxJ- 40 
ules in the layered decoder. The selective interconnec- 
tion path selectively connects the output of one of the 
decoding modules to the input of the decoded bitstream 
processor and selectively connects the output of the 
decoded brtstream processor to the input of the one of 45 
the enootfing modules corresponding to the one of the 
decoding nrodulesw 

The invention also provides an apparatus for modi- 
fying the brtstream characteristics of a conpressed 
input bit^eam representing an information signal. This so 
apparatus modifies the bitstream characteristics of the 
compressed input bitstream without necessarily sut>- 
stantially changing the information signal represented 
by the compressed input bitstream. The apparatus conv 
prises a controller that provides an output bitstream def- ss 
inition defining the bitstream characteristics of a 
conpressed output brtstream; a layered decoder that 
includes a deriving element that derives txtstream 


parameters from the compressed input bitstream; a bit- 
stream parameter forwarding path; and a layered 
encoder tfiat generates the conpressed output tut- 
stream. The layered decoder decodes the compressed 
input bft^eam to provide a decoded bitstream. The brt- 
stream parameter torwarding path ^ connected to 
receive the bitstream parameters from the layered 
decoder. The layered encoder is connected to the bit- 
stream parameter fbnwarding path and re-uses the bit- 
stream parameters derived from the compressed input 
bitstream to re-encode the decoded bitstream in 
accordance wnth the output bitstream definition. 

The invention also provides a nr^ettiod for process- 
ing a compressed input bitstream representing an infor- 
mation signal. The method processes the compressed 
Input bitstream in a way tfiat changes the informatton 
signal represented by the conpressed input bitstream. 
In the method, the conrpressed input bitstream is par- 
tially decoded to proride a decoded brtstream. The 
decoded bitstream is a partially-encoded bitstream rep- 
resenting the information signal. A modified bitstream is 
generated by processing ttie decoded brtstream in a 
way tfiat modifies the Information signal. The modified 
brtstream is a partial ty-encoded bitstreant Finally, the 
modified brtstream is re-encoded to generate a com- 
pressed output bitstream. 

The invention further provides a method for modify- 
ing the bitstream characteristics of a conrpressed input 
brtstream representing an information signal. This 
method modifies the brtstream characteristics without 
necessarily substantially changing the information sig- 
nal represented by the compressed input bitstream. In 
the metiv)d. an output brtstream definition is generated. 
The output brtstream definition defines the bitstream 
characteristics of a conpressed output bftstream. Bit- 
stream parameteis are derived from the compressed 
input brtstream. The conpressed input brtstream is at 
least partially decoded to proride a decoded bitstream. 
Finafly. the decoded bitstream is re-encoded using the 
parameters derived from the conpressed input bit- 
stream to generate the compressed output brtstream 
having the bitstream cftaracteristics defined by the out- 
put brtstream definition. 

TTie invention also provides an apparatus for 
processing a compressed input bitstream representing 
an information signal. The apparatus processes the 
compressed input bitstream in a way ttiat changes the 
infomrution signal represented by the conpressed input 
bitstream. The apparatus oonprises a first conpression 
state translation unit a processor and a second conr>- 
pression state translation unit The first compression 
^te translation unit receives the compressed input bit- 
stream as an input bitstream arvJ changes the conpres- 
sion state of the conpressed input bitstream to 
generate an output bitstream. The processor receives 
the output brtstream of the first compression state trans- 
lation unit, and processes the output bitstream to gener- 
ate a modified tMtstream. The processor processes the 
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output bitstream in a way that modifies ttie information 
signal. The second compression state translation unit 
receves the modified bitstr^m as an input bitstream 
and changes the contpresston sbte of the modified bit- 
stream to generate an output bitstream as the com- 
pressed output tntstream 

The first and second compression state translation 
units each include layered encodir>g/ldecodiRg modules, 
an input interface module and an output interface mod- 
ule. The input interface module selectively connects the 
input bitstream to one of the ertcoding/decoding mod- 
ules. The one of the enooding/decoding modules to 
which the input bitstream is connected depends on the 
compression state of the input bitstream. The output 
interface module selectively receives a bitstream from 
the output of one of the encoding/deoodng modules as 
the output bitstreaia The one of the enoodingAlecocfing 
modules from which the bitstream is recoved depends 
on the compression state of the output bitstream. The 
conrrpresston state of the output bitstream may l>e differ- 
ent from that of the input bitstream. 

Finally, the invention provides a method for 
processing a compressed input beam representing an 
information signal. In the method, layered encod- 
ing/decoding modules are provided. A first set of encod- 
ing/decoding modules and a second set of 
encodng^decoding modules are selected from the lay- 
ered encoding modules. The compression state of the 
compressed input bitstream is changed to prc^e a first 
output bitstream using the f irst set of encoding/decoding 
modules. The first output tsitstream is processed to gen- 
erate a modified bitstreanu The first output t»tstream is 
processed by in a way that modifies the information sig- 
nal but genemtes the modified bitstream in the same 
compression state as the f irst output bitstream. RnaOy, 
the compression state of the modified bitstream is 
changed using the second set of encoding/decoding 
ntodules to generate a second output bitstream. 

Brief Description of the Drawings 

Rgure 1 is a block diagram of a conventional appa- 
ratus for processing a compressed input bitstream. 
Figure 2 is a block diagram of a first embodiment of 
an apparatus according to the invention for 
processing a compressed input bitstream. 
Rgure 3 a block diagram showing part of the first 
embodiment of the apparatus according to the 
irrvention in more detail. 

Rgure 4 is a block diagram that illustrates how bit- 
stream parameters derived from the compressed 
input bitstream are re-teed in the layered encoder 
in the apparatus according to the invention. 
Rgure 5 is a flow chart that illustrates a first way in 
which quantizing is performed in the layered 
encoder by re-using quantizing parameters derived 
from the compressed input bitstream. 
Rgure 6 is a flow chart that illustrates a second way 


\n which quantizing is performed in the teyered 
encoder by re-using quantizing parameters derived 
from the compressed input txtstream. 
Figure 7A is a block (fiagram of a second embodi- 

5 ntent of an apparatus according to the invention for 
processing a compressed input bitstreara 
Rgure 7B is a block diagram showing d^ls of the 
compression state translation units of the second 
embodiment of the apparatus according to the 

10 invOTtion. 

Detailed Description o9 the Invention 

In the following description, reference will be made 

IS to the compression state of an information signal. Bit- 
streams compressed according to MPEQ and similar 
compression schemes are the result of a prescribed 
number of layers of compression applied to tfie original 
information signal. Compressed bitstreams can also be 

20 generated by applying fmver than the pfescrbod 
number of layers of compression to the information sig- 
nal. Accordingly, a compressed bitstream representing 
an Information signal can be regarded as having a com- 
pression state that depends on the number of layers of 

25 compression that have been applied to the information 
sigr^. The compression state of a compressed bit- 
stream can b9 increased by applying additional layers of 
encoding operations to the compressed bitstream. and 
can be decreased t^y applying layers of decoding oper- 

30 ations to the compressed bitstream. 

A first emtxKfiment 100 of a compressed bitstream 
processing apparatus according to the invention is 
shown in Rgure 2. The example shown is adapted for 
processing an MPEG-compliant video bitstream. but 

35 can easily be adapted for processing other types of 
co mp ressed bitstreams representing information sig- 
nals The compressed bitstream processing apparatus 
100 is composed of four main units, the layered decoder 
114. the decoded bitstream processor 118, the layered 

40 encoder 124 and the t>itstream parameter forwarding 
path 1 28 that interconnects the layered decoder and the 
layered encoder. In addition, if the compressed bit- 
stream processing apparatus is designed to allow a 
user to select or define the processing operation per- 

45 formed, the apparatus additionally includes the 
processing selection module 120 that receives instruc- 
tions from the user and controls the processing per- 
formed t)y the layered decoder, the processor and the 
layered encoder. Othenftfise. the processing selection 

50 module controls the processing performed by the lay- 
ered decoder, the bitstream processor and the layered 
encoder so that the compressed bitstream processing 
apparatus performs a predetermined processing opera- 
tion on the compressed input bilstreanv 

66 The layered decoder 1 1 4 decodes the compressed 
input bitstream 1 12 to generate the decoded bitstream 
1 16 and passes the decoded bitstream to the decoded 
bftstream processor 116. The layered decoder gener- 
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ates the decoded brtstream in the compression state 
rec^ired by the decoded brtstream processor 118. For 
exanple^ when the decoded bitstream processor is a 
conventional bitstream processor that operates on a 
conventional video bitstream. the decoded bHstr^m is 
a conventional video bitstream Atterrtativefy, the 
decoded bitstream processor may operate on a par- 
tiaUy-compressed video bitstream. such as a bitstream 
composed primarity of DCT coefficients. In this case, 
the decoded bitstream is composed primarily of DCT 
coefficients. 

The layered decoder 1 14 adcfitionally derives from 
the compressed input bitslream various parameters that 
win be called bitstream parameters. The bitstream 
parameters are parameters that are extracted from the 
compressed input bitstream 1 12. or that are derived by 
the layered decoder in the course of decoding the com- 
pressed input bitstream. tn the tolhywing descnption, the 
term derived will be understood to encompass either of 
these possftMlrties. The bitstream parameters collec- 
tively define each picture of the video bitstream repre- 
sented by the oonrpressed input brtstream. and indude 
coded, quantized DCT coefficients, motbn vectors, 
quantizing tables, macroblock-type information. BPd 
header irrformation. The header information includes 
statistical information such as the nurrber of bits per 
block and the nunnber of bits per pictura Thie layered 
decoder forwards the bitstream parameters to the lay- 
ered encoder 124 through the bitstream parameter for- 
warding path 128. 

The decoded brtstream processor 118 processes 
the decoded bitstream 1 16 it receives from the layered 
decoder 114. and passes the resulting modified bit- 
stream 122 to the layered encoder 124. T))e layered 
encoder is also connected to the txtstream parameter 
fonvarding path 128 from which it receives the bitstream 
parameters derived from the compressed input bit- 
stream 112 by the layered decoder. The layered 
encoder generates the conpressed output bitstream 
126 by wholly or partially re-encoding the modified bit- 
stream. In this embodiment the extent of the re-encod- 
ing performed by the layered encoder is the same as the 
extent of the decoding performed by the layered 
decoder. 

The layered decoder 114 operates only to decode 
the compressed input bitstream 112 to the state of com- 
pression required by the decoded bitstream processor 
1 18. This state of compression is less than that of the 
compressed input bitstream 112. but may be greater 
than ttiat of a conventional video bitstream. In this 
embodiment, the modified brtstream 122 is in the same 
state of compression as the decoded brtstream 116. 
The layered encoder 124 re-encodes the nrxxfrfied bit- 
stream re-using at least some of the bitstream parame- 
ters derived from the compressed input bitstream 1 12 
by the layered decoder 114. Revising the bitstream 
parameters saves the layered encoder from expervfing 
conputational resources to calculate new parameters 


equivalent to the tiilstream parameters that are renjsed. 
Consequently, the compressed bitstream processing 
apparatus 100 according to tte invention can perform 
the desired processing of the compressed input bit- 

5 ^eam using a smaller scale of hardware or a less pow- 
erful computer or digital signal processor than a 
conventional compressed bitstream processing appara- 
tus. Altemativety, compared wr^ a conventional appara- 
tus, the conpressed bitstream processing apparatus 

10 according to the invention can perform the desired 
processing at a faster rate. e.g., faster iJhan real-time, 
using given hardware or a given computer. 

The conrpressed bitstream processing apparatus 
100 wiD now be descrbed in more detail. In partkrular, 

IS the layered decoder 114 and the layered encoder 124 
wiD be deserved in detail with reference to Rgures 2 
and 3. 

The layered decoder 1 14 will be described first. The 
layered decoder receives the conpressed input brt- 

so stream 112, partially or fully decodes the conrpressed 
irput t)(tstream, and supplies the resulting decoded brt- 
stream 116 to the decoded bitstream processor 118. 
The layered decoder also derives bitstream param^ers 
from the compressed input bitstream and suppGes the 

25 brtstream parameters to the layered encoder 1 24 via the 
brtstream parameter fonMarcGng path 128. In the exam- 
ple shown, the conrpressed input bitstream and the 
compressed output bitstream 126 are both MPEG-com- 
pliant video brtstreama 

30 Like a conventional MPEG decoder, the layered 
decoder 114 includes a number of serially-connected 
decoding nvxiules that operate together to decode the 
compressed input brtstream 1 12. UnKke a conventional 
MPEG decoder, the layered decoder can stop decoding 

35 the conpressed irput bitstream at the corrptetion of 
decoding by any one of the decoding modules so that 
the compressed input brtstream is decoded only to the 
compression state required by the decoded bitstream 
processor 118. The decocfing nrxxJule at which the lay- 

40 ered decoder stops decoding depends on decoding 
control data supplied by the processing selection wod- 
ule 120 via the control path 132. When the decoding 
control data set the layered decoder so that all the 
decoding modules operate to decode the conpressed 

45 input bitstream. the layered decoder decodes the com- 
pressed input brtstream to generate the decoded bit- 
stream 116 as a conventional video bitstream. The 
pictures of a convemional video bitstream are in presen- 
tation order and the bitstream includes a pixel value for 

50 each pixel of each picture. When tf^e decoding control 
data set the layered decoder so that fewer than all the 
decoding modules are selected to decode the com- 
pressed Input bitstream. the conpressed input bit- 
stream is only partially decoded. In this case, the 

55 decoded bitstream 1 16 is not a conventional video bit- 
stream, but is partially compressed. For exanpie, the 
decoded brtstream may comprise a set of DCT values 
tor each block of each picture. 
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Since the layered decoder 114 can stop decoding 
ttie oonpressed input brtstream at the completion of 
decoding by any one of the decoding modules, the out- 
put of each decoding module is not only connected to 
the input of the fdloiMng decoding nnodule. but is also $ 
connected to the output bus 134 that feeds the output 
s^ector 215. The output selector will be descrbed in 
more detail beHoH. 

The decoding modules that constitute the layered 
decoder 1 14 are based on coresponding modules of a io 
conventiona] MPEG decoder. It ts assumed that the per- 
son of ordinary skill in this art is familiar with the struc- 
ture and operation of such conventional modules, so the 
decoding modules wiD only be described bridty. The 
decocGng modules include the decoder buffer 201, the 75 
denruftiplexer 203, the inverse variable-length coder 
205, the inverse quantizer 207, the inverse discrete 
cosine transform module 209, the nrtotion compensator 
21 1 and the spatial bttstream output module 213. 

The compressed input bitstream, a constant bit-rate 20 
video stream in this exanple, is tempofar3y stored in 
the decoder buffer 201. The compressed input bit- 
stream is transferred from the decoder buffer to the 
demultiplexer 203 one picture at a time in response to 
tinning control data located in headers emt>edded In the 2S 
bitstream. The demuttipiexer (fivides the portion of the 
cornpressed input brtstream relating to each picture into 
its constituent bitstream parameters. The brtstream 
parameters collectively define each picture of the video 
bitstream represented by the compressed input bit- 3o 
stream, and include coded, quantized DCT coefiidents, 
motion vectors, quantizing tables, macroblock-type 
information, color data, and header information. The 
header information includes statistical infornr^ation such 
as the nunnber of bits per block and the number of bits as 
per pichjre. The decoder bitstream parameter bus 136 
interconnects the output of the demultiplexer with inputs 
of the other decoding modules, and passes ttie bit- 
stream parameters from the demutt(plexer to the ottter 
decoding modules. The decoding modules each per- 40 
form a decoding operation using not only the data 
received from one or nfx>re preceding decoding nxxiules 
but also the bitstream parameters received via the 
decoder bitstream parameter bus. In addition* the 
decoder bttstream parameter bus is connected to the 4s 
bitstream parameter forwarding module 1 30 to form part 
of the bitstream parameter forwarding patti 128. 

The bitstream parameter forwarding nxx^ute 130 
receives the brtstream parameters from the layered 
decoder 114 via Oie decoder bitstream parameter bus $0 
136. The brtstream parameter forwarding module tem- 
porarily stores those of the bitstream parameters that 
win be used by either or both of the decoded brtstream 
processor 118 and the layered encoder 124 until they 
are needed. The bitstream parameter fomvanding mod- ss 
ule also feeds the brtstream parameters to an appropri- 
ate channel of the encoder brtstream parameter bus 
140. The encoder bitstream parameter bus connects 


ttie bitstream parameters to ttie encoding nK)dules of 
ttie layered encoder in which ttie bitstream parameters 
will later be used to re-encode themotfifted bitstream 
122. 

The inverse variable lengtti coder 205 receives the 
coded, quantized DCT coefficients from the demulti- 
plexer 203 and reverses the variable lengtti coding 
applied to tiiese coefficients to generate quantized OCT 
ooefTcients. The quantized OCT coefficients are fed to 
the inverse quantizer 207 and also to ttie output bus 1 34 
for connection to ttie output selector 215. In addition, 
ttie quantized OCT ooeffidents may be fed as brtstream 
parameters to the brtstream parameter fonwarefing path 
128 for forwarding to ttie layered encoder 124. 

The inverse quantizer 207 receives ttie quantized 
DCT ooeffidents from ttie inverse variable lengtti coder 
205, and also receives the quantizing tables from ttie 
demultiplexer 203 via ttie decoder bitstream parameter 
bus 136. The inverse quantizer reverses the quantizing 
applied to the quantized DCT coefTidents to generate 
blocks of DCT coeff identa The DCT ooeffidents are fed 
to ttie inverse OCT module 209. and also to ttie output 
bus 134 for connection to the output selector 215. In 
addition, ttie DCT ooeffidents may be fed as bitstream 
parameters to the bitstream parameter fonvarding patii 
1 28 for fon^rding to ttie layered encoder 124. 

The inverse OCT module 209 receives the blocks of 
DCT coeffidents from the inverse quantizer 207 and 
applies an inverse disaete cosine ttanstorm to the 
Uocks of DCT coeffidents to generate respective blocks 
of differences. The blocks of differences are fed to the 
motion conpensator 211, and also to the output bus 
134 for connection to ttie output selector 215. In addi- 
tion, ttie blocks of differences may be fed as bitstream 
parameters to the bitstream parameter torwarcfing patti 
1 28 tor forwarding to tfie layered encoder 124. 

The motion compensata 211 receives ttie blocks of 
differences from the inverse OCT module 209 and also 
receives respective reference blocks from a recon- 
structed picture stored in a page of a picture memory 
(not shoMfn) in tfie spatial bitstream output module 213. 
The picture memory selects the respective reference 
bfocks from the reconstructed picture in response to the 
motion vectors for ttie blocks of differences. The picture 
memory receives ttie motion vectors from ttie multi- 
plexer 203 via ttie decoder bitstream parameter bus 
136. The motion compensator adds each difference in 
the block of differences to a corresponding pixel value in 
the reference block to generate a new pixel value of a 
new reconstructed picture block. The motion compen- 
sator feeds the reconstructed picture block to ttie spatial 
bitstream output module 213. The motion compensator 
also feeds ttie reconstructed picture block onto the out- 
put bus 134 for connection to ttie output selector 215. 
The successive reconstructed picture blocks fed to ttie 
output selector constitute a block-format vkieo brtstream 
in which ttie pictures are in coding order. Coding order 
differs from presentation order, i.e., ttie order in which 
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the pictures are presetted to the viewer. 

When the block of differerfces is a block of a picture 
that has been encoded as a B-picture. the reference 
block may be selected from two reconstructed pictures 
stored in the picture memory. However, to simplify the s 
following description, a referef^e to eetecting a block of 
a reconstructed picture will be taken to enconrpass 
selecting btocte of more than reconstructed picture 
when ttte pcture is decoded or encoded as a B-picture. 

The spatial bitstream output module 213 receives io 
each reconstructed picture block from the motion com- 
pensator 21 1 and stores the reconstructed picture block 
in the picture memory as a bock of a reconstnicted pic- 
ture being constructed in a page of the picture memory. 
This page is different from the page in which the picture is 
that supplied the reference block is stored. When all the 
blocks of a reconstructed picture have been stored in 
the picture memory, the reconstructed picture is availa- 
ble tor the spatial bitstream output module to read it out 
onto the output bus 134 for cormection the output selec- 20 
tor 215. The spatial bitstream output module reads out 
the reconstnjcted picture in raster scan fonmat and in 
presentation order as a picture of a conventional video 
bftstream. 

As noted above, the inverse variable-length coder 2S 
20s. the inverse quantizer 207, the inverse OCT module 
209, the motion compensator 211 and the spatial bit- 
stream output module 213 operate selectively in 
response to the decoding control data received from the 
processing selection module 120 via the control path 30 
132. The decodng control data select the decoding 
modules acti^ty used to decode the compressed input 
bitstream. For exarrple. tf the user commarKts the sys- 
tem to perform spatial filtering on the compressed input 
bitstream. and the decoded bitstream processor 1 18 is as 
capable of performing such filtering on blocks of DOT 
coefficients, the decoding control data will enable the 
inverse variable-length coder 205 and the inverse quan- 
tizer 207, and will cause the output selector 215 to con- 
nect the partially-decoded bitstream from the inverse 40 
quantizer to the decoded bitstream processor 118 as 
the decoded bitstream 1 16. TTie decoding control data 
win also deactivate the decoding nrvxJules downstream 
of the decoding module whose output is selected as the 
decoded t)rtstream 116, i.a* the inverse OCT module 45 
209. the motion compensator 211 and the spatial bit- 
stream output module 213. These decoding modules 
can be deactivated since they are not required to 
decode the oonpressed input bitstream to the OCT 
coefficient lorel. This enables corrputationaJ resources so 
that wouki otherwise be used for these decoding mod- 
ules to be used tor other purposes. 

In the layered decoder 1 14. the output selector 215 
IS connected to the output bus 134, through which it 
receives the outputs of the decoding modules 201-21 3. ss 
The output selector is also connected to the control path 
132 through which it receives the decoding control data. 
The output of the output selector is connected to the 


input of the decoded bitstream processor 116. tn 
response to the decoding control data, the output selec- 
tor selects the output of one of the decodir>g modules 
that win sen^e as the decoded bitstream 1 1 6. and feeds 
this t>itstream to the input of the decoded brtstream 
processor 1 18. 

It should be noted that when the conpressed bit- 
stream processing apparatus 100 acoorcfing to the 
invention is embodied In a computer or digital signal 
processor, the computer or digital signal processor nnay 
lack elements such as the bitstream parameter forward- 
ing path 128. the bitstream parameter forv^ing mod- 
ule 130. the output bus 134 and 9ie decoder bftstream 
param^er bus 13a Instead, for example, the output 
selector 215 may conrmunicate to the decoded bit- 
stream processor 118 the addresses where the data 
output by the last of the decoding nrvxluies to decode 
the oonpressed input t>rtstream are stored. The 
decoded ft>itstream processor can then fetch the data 
stored at these addresses and perform the decoded bit- 
stream processing on these data Similarly, the bit- 
stream param^er forwaiding path 128 may 
communicate to the layered encoder 124 the addresses 
at which the bitstream parameters derived from the 
compressed input bitstream by the layered decoder are 
stored. The appropriate encoding module of the layered 
encoder 124 can then fetch the bit^eam parameters 
stored at these addresses to use them in performing its 
encoding processing. It shouU also be noted that, in 
computer-based and DSP-based embodiments, the 
decoding modules may t>e ephemeral, and the appara- 
tus may lack elements conesponding to those of the 
decoding modules that are not used to decode the com- 
pressed input bitstream 1 12. 

The decoded bitstream processor 118 will be 
described next. The decoded bitstream processor 
recces the decoded bitstream 116 from the layered 
decoder 114 and processes the decoded bitstream to 
generate the modified bitstream 122. The decoded bit- 
stream processor can perfomi any conventional 
processing operation that is not part of the MPEG conv 
presstoa These processing operations include cokx 
oonection. scaling, sharpening, noise reduction, etc. In 
the example shown, ttie processing operation per- 
fomned by the decoded bitstream processor 1 18 on the 
decoded bitstream 1 1 6 is user specific, and is set by the 
users input to the processing selection module 120. 

The processing operation performed by the 
decoded bitstream processor 1 1 8 depends on the com- 
pression state of the decoded bitstream 1 16. For exanv 
pie. the decoded bitstream processor can perform a 
pk:ture sharpening operation on either the corNentional 
video bitstream generated by the spatial bitstream out- 
put module 213 or the OCT coefficients generated by 
the inverse quantizer 207. To achieve the desired pic- 
ture sharpening result, the decoded bitstream proces- 
sor will perfonn a different picture sharpening operation, 
depending on whether the decoded bitstream 1 16 was 
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generated by the spatial bitstream output module or by 
the inverse quantizer. 

Whether the deooded bitstream 116 processed by 
the decoded brtstream processor 118 is the resUtofthe 
layered decoder 114 fuDy decoding or only partially s 
decoding the coirpressed input brtstream 112 depends 
on a trade-off between picture quality and conputa- 
tional conplexity. For example, when the decoded bit- 
stream processor performs a picture sharpening 
operation on the conventional video bitstream gener- io 
ated by tfie spatial brtstream output module 213 of the 
layered decoder, the results are typically subjectively 
better than when those obtained when the decoded bit- 
stream processor performs a picture sharpening opera- 
tion on the DOT coefficients generated by inverse is 
quantizer 207. However, the decoded bitstream proces- 
sor operating on the conventional video brtstream is less 
cost effective because more computational resources 
must be expended to provide the additional decocfing 
and encoding modules required for the layered decoder 20 
to decode the compressed irput bitstream to the con- 
ventional video brtstream level and for the layered 
encoder to re-enoode the modified video brtstream from 
the conventional video bitstream level. 

In instances in which the compressed bitstream 2S 
processing apparatus 100 is configured to mocfify the 
bitstream characteristics of the compressed input bit- 
stream 112 without modifying the video signal repre- 
sented by the compressed input brtstream. the 
processing selector 120 configures the decoded bit- 30 
stream processa 1 1 8 as an identity unit, and the modi- 
fied brtstream 122 is identical to the decoded brtstream 
116. Exanpies of nrxxlifying the bitstream characteris- 
tics of the compressed irput bitstiream include changing 
the bit rate, changing the reference buffer size, chang- 35 
ing the quantizing table, etc. 

The layered encoder 124 will be described next 
also with reference to Rgures 2 and 3. A key feature of 
the layered encoder lies in that it re-encodes the modi* 
fied bitstream 122 using the brtstream parameters 40 
derived from the compressed input bitstream by the lay- 
ered decoder 114. Using tt^e brtstream parameters in 
the layered encoder enatsles the layered encoder to re- 
encode the modified txtstream using fewer corrputa- 
tional resources than if it generated the brtstream 45 
parameters anew. Fa exarrple. re-ertcoding the modi- 
fied bitstream using the nxtion vectors and DOT infor- 
mation derived from the conpressed input bitstream 
can significantly reduce the computatonal resources 
required to perform many modifications to the bitstream so 
characteristics of the compressed input bitstream. For 
example, such modifications of the bitstream character- 
istics as bit-rale conversion, decoder buffer size 
change, and picture size scaling can be performed. 
When such modifications of the bitstream characteris- ss 
tics are performed, the re-encocfing can be performed 
using either the original motion vectors derived from the 
corrpressed input bitstream. or new rrxytion vectors. 


The new motion vectors are generated using the origi- 
nal motion vectors as the starting points for a signifi- 
cantly srrpter local search. The decision on whether to 
ecpand the additional corrputing resources required to 
generate new motion vectors involves a traded 
between the quality of the motion vectors arvf the adcfi- 
tional computing resources required. When the original 
motion vectors are used to re^code the modified bit- 
stream after picture scaling, they must also be scaled in 
proportion to the picture scaling factor. 

The layered encoder 124 can also re-encode the 
modified bitstream 122 using information relating to the 
DOT coefficients of the compressed input bitstream 1 12 
as bitstream parameters. This provides both computa- 
tional expediency and reduces the conputational 
resources required to control the encoder buffer and 
output bit rate. For example, the DOT module of ttie lay- 
ered encoder can use bitstream parameters that indi- 
cate the locations of ttie non-zero OCT coeffidents in 
each block in the compressed input bitstream to 
inrprove tiie speed at which it computes the fbnwaid 
DCT. The DCT module need only compute the OCT 
coeffid^ for the non-zero locations inc£cated by the 
bitstream parameters. Furthermore, the quantizer of tt)e 
layered encoder can use brtstream parameters tttat indi- 
cate the bit statistics of the DCT coeff idertts of the com- 
pressed input brtstream to oonti'ol the quantizing factor 
•MQUANTT." 

The layered encoder 124 generates the com- 
pressed output bitstream 126 from the modified brt- 
stream 122 output by the decoded brtstream processor 
1 1 a In the example shown in Figures 2 and 3. the com- 
pressed output bitstream is an MPEG^mpliant video 
bitstream with a new set of user-spedfic MPEQ header 
constraints defined by the processing selection nxxlule 
120. Howo/er, the header information of the com- 
pressed output bitstream may or may not be ttie same 
as that of the compressed input bitstream 1 1 2 in all lay- 
ers except the data layer. The layers include sequence. 
GOP. picture, slice. MB. and any extension header infor- 
mation. 

It is inportarrt to understand the principal differerK» 
tTehween layered encoder 124 and the decoded bit- 
stream processor 118. Unlike the decoded bitstream 
processor, the layered encoder is only respons&te for 
generating the compressed output bitstream 126 based 
on the user-spedfied header information and the modi- 
fied brtstream 122 from the decoded brtstream proces- 
sor 1 18. The layered encoder does not alter the video 
signal represented by ttie compressed output bitstream. 
accept that the quantizer of tt)e layered encoder may 
quantize the DCT coeffidents differently from the way in 
which they were quantized in the compressed input bit- 
stream 

The layered encoder 124 receives the modified bit- 
stream 122 from the deooded bitstream processor 1 18, 
re-encodes the modified bitstream using brtstream 
parameters derived from ttie compressed input bit- 
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stream 112 by the layered deooder 114. and supplies 
the resuKng corrpressed output brtstream 126 as the 
output of the oonrpressed bftstream processing appara- 
tus 100. The bitstreani parameters are forwarded from 
the layered decoder to the layered encoder via the bit- $ 
stream parameter forwarding path 128. The layered 
encoder re-encodes the nvxfified brtstream only to the 
extent required by the conpresston state of the nrvxiif led 
brtstream and the need to generate the compressed 
output brtstream 126 with the bitstream characteristics w 
set by the ertcoder control data. 

The taya-ed encoder 124 operates according to 
encoding control data supplied by the processing selec- 
tion Uock 120 via the control path 142. Ihe encoding 
control data include header infornwtion for the com- is 
pressed output bitstream 126. The encoding control 
data depend on processing selectiorYs input by the user 
(not shmm) into the processing selector 120. 

Like a conventional MPEG encoder, the layered 
encoder 124 includes a number of serialty-oonnected so 
encoding modules that operate together to encode the 
modified brtstream 122. Unlike a conventional MPEG 
encoder, the layered encoder can receive the modified 
brtstream in a partially-compressed state, and can use a 
subset of its encoding modules to encode the partiaDy- 25 
compressed modified brtstream to the extent required to 
provide the compressed output bitstream with bitstream 
characteristics defined by the encoding control data. 

The encoding control data supplied by the process- 
ing selection module 1 20 via the control path 1 42 deter- so 
mine the encoding module at which the layered encoder 
begins encoding. When the modified bitstream 122 is 
uncorvpressed. i.a, the nrKxfrfied bitstream is a conven- 
tional video brtstream having a pixel value for each pixel 
of each picture, the encoding control data set the lay- 35 
ered encoder to encode the modified bitstream using all 
the encoding rrxxlulea However, when the decoded kwt- 
stream 1 16 processed by the decoded bitstream proc- 
essa lie was only partially decoded by the layered 
deooder 114. the modified bitstream is partially oonrv 40 
pressed, and is not a conventional vkieo bitstream. In 
this case, the encoding control data select a sut>set of 
the encoding modules for tfie layered encoder to use to 
complete the encoding of the partially-compressed 
modified bitstream. For example, the decoded tTitstream 4s 
processor 118 nrviy perform its processing on a 
decoded bitstream 118 composed of blocks of DCT 
coefficients. In this case, the modified bitstream 122 is 
also partiaDy conrpressed. and the layered encoder 
encodes this nrvxfified bitstream by processing the so 
blocks of DCT coefftdents of the modified bitstream 
without using the spatial bitstream input module, the 
nnoton compensator, the DCT module, and the local 
decoder. 

The encoding modules that constitute the layered ss 
encoder 124 are based on the corresponding modules 
of a conventional encoder. It is assumed that persons of 
orcfinary skiQ in this art are fam3iar with the structure 


and operation of such conventional encoding modules. 
60 the encoding modules will be descrft)ed only briefly. 
The encodir^ rTxxlules constituting the layered encoder 
include the spatial bitstream input module 313. the 
nvytion compensator 31 1 . the cfiscrete cosine transform 
(DCT) module 309. the quarftizer 307. the variable- 
length coder 305. the multiplexer 303, the encoder 
buffer 301 and the local deooder 31 7. 

In adcfition to the above-mentbned encocfing mod- 
ules, the layered encoder 124 tncfudes the input selec- 
tor 315. the input bus 138 and the encoder bitstream 
parameter bus 140. The input selector has an input con- 
nected to the output of the decoded bitstream processor 
118 through which it receives the modified brtstream 
122. The input selector has an output connected to the 
input bus 138. The input bus is in turn connected to the 
input of each of the spatial brtstream input module 313, 
the motion compensator 31 1 . the DCT module 309. the 
quantizer 307. the variable-length coder 305. and the 
multipleKer 303. The input selector has a control input 
connected to the control path 142 through which it 
receives the encoding control data. In response to the 
encoding control data, the input selector detemnir^ 
which of the spatial bitstream input module 313. the 
motion conr^>ensator 311. the DCT module 309. the 
quantizer 307. and the variable-length coder 305 is the 
first of the encoding modules that will process the mod- 
ified bitstream. The input selector then connects the 
input of the first-to-procees moding nxxjule to the out- 
put of the decoded bitstream processor 118 via the 
input bus 138. For example, when the modified beam 
1 22 from the decoded bitstream processor 1 1 8 is a con- 
ventional video bitstream in raster scan format and 
presentation order, the input selector 315 connects the 
output of the decoded brtstream processor 118 to the 
input of the spatial bitstream input module 313. The 
spatial bitstream input nxidule can then convert the 
raster-scan and presentation-order format of the nrxxli- 
fied bitstream into macrobtocte arvj blocks in coding 
order for processing by the remaining encoding mod- 
ules of the layered encoder. 

The efKoder bitstream paranwter kxis 140 has 
ir^uts connected to the output of the txtstream parame- 
ter fonwarding module 130 and outputs connected to an 
actiftk>nal input on each of the encoding nKxiules 303- 
313. The additional inputs connected to the encoder bit- 
stream parameter bus enable the encoding modules to 
receive the bitstream parameiters derived from tfie com- 
pressed input bitstream by the layered decoder 1 14 and 
fonvarded via the bitstream parameter forwarding path 
128. 

In the layered encoder 124. the spatial input bit- 
stream module 313 receives a conventional video bit- 
stream in raster-scan format and presentation order, 
and converts the video bitstream into blocks and nr^c- 
roblocks in coding order suitable for processing by the 
remaining encoding modules of the layered encoder. 
The spatial input brtstream module feeds the resulting 
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block-format video tttstream to the motion conrq[>ensator 
311. 

The motion compensator 31 1 detemnines a ration 
vector for each macroblock of each picture that wilt be 
encoded as a P-ptcture or a B-picture. These pictures 
are the pictures that wiD not be independently encoded 
as l-pictures. Conventionally, the motion vector for each 
macroblock is detemvned by performing a block match- 
irtg operation between the macroblock and reference 
blocks selected from one or more reference pictures. 
The reference pictures are usually reconstructed pic- 
tures obtained as a result of the local decoder 317 
decoding the bitstrearn output by the quantizer 307. The 
reconstructed pictures are stored in a multi-page picture 
memory that forn» part of the local decoder. 

In a conventional encoder, the block matching oper- 
ation to determine the motion vectors demands the 
most computational resources of any of the operations 
performed by the encoder. However, the computational 
requirements tor determining the motion vectors in the 
compressed bitstream processing apparatus 100 are 
substantially reduced or e^en elirrunated by re-using the 
motion vectors derived from the compressed input bit- 
stream 112 by the layered decoder 114 and forwarded 
to the layered erKoder via the bttstream parameter for- 
wanfing path 128. 

The motion compensator 311 addiUonalty proc- 
esses the blocks of the pictures that will be encoded as 
P-pictures and B-pictures to generate difference blocks. 
The blocks subject to this processing will t>e called pic- 
ture blocks to distinguish them from the reference 
blods and the difference blocks. The difference bk>ck 
for each picture block is obtained by a subtraction oper- 
ation performed between the picture block and a refer- 
ence titock. The reference block is the block of the 
reference picture ira£cated by the motion vector of the 
picture block. 

The motion compensator 31 1 also passes encod- 
ing blocks to the DCT module 309. Encoding bkxks are 
picture blocks rf the picture is to be encoded as an l-pic- 
ture, and are the difference tslocks generated as just 
desaibed if the picture is to be encoded as a P-picture 
or a B-picture. 

The DCT module 309 receives the encoding blocks 
from the motbn compensator 311 and orthogonally 
transforms each encoding block from the spatial domain 
to the frequency domain using a disaete cosine trans- 
form. The DCT module passes the resulting blocks of 
DCT coefficients to the quantizer 307. 

The quantizer 307 receives the blocks of DCT coef- 
fidents from the DCT module 309 and quantizes each 
of the DCT coefficients in each block. The quantizing 
step^ze is controlled by a buffer occupancy control sig- 
nal (not shown) genemted by the encoder buffer 301. 
The quantizing step size is controlled to ensure that the 
encoder buffer and a hypoth^'ca) standard video 
decoder buffer neither overflow nor underflow. The 
quantizer passes the resulting blocks of quantized DCT 


coefficients to the variable-length coder 305. 

The variable-length coder 305 receives the Uocte 
of quantized DCT coeffidents from the quantizer 307 
and appGes variatile-lerigth cotfing to the quantized 

5 DCT coeffidents in each block. The variable-length 
coder passes the resulting blocte of coded quantized 
DCT coeffidents to the mutt9)lexer 303 and to the local 
decoder 317. 

The muftq)lexer 303 receives the t)Iocks of coded 

10 quantized DCT coeffiderTts from the variable-length 
coder 305. and additx)nalty receives parameters such 
as motion vectors from the motion compensator 311. 
quantizing step size information from the quantizer 307, 
and run-length infornation from the variable-length 

16 coder 305. axvi combines these parameters to generate 
a picture-tayer video bitstream. The multiptexer passes 
the resulting video brtstream picture-by-picture to the 
output buffer 301. 

The output buffer 301 receives the video bitstream 

20 from the multiplexer 303 and generates the compressed 
output bitstream 126. a constant bit-rate bit stream. An 
adifitional multiplexer (not shown) may interteave the 
compressed output bitstream with ot)er bitstreams. 
such as a compressed audio bitstreara and with addi- 

25 tional header informatk)n. to generate a composite out- 
put bitstream. 

The spatial brtstream input module 313. the motion 
compensator 311. the DCT module 309. the quantizer 
307 and the variable-length coder 305 operate selec- 

30 tively in response to the encoding control data received 
from the processing selection module 120 via the con- 
trol path 142. The encoding control data determine 
whether each of the above modules will actually oper- 
ate. For example, if the user desires to perform spatial 

35 faterirvg on the compressed input bitstream. and the 
decoded bitstream processor is capable of perforning 
such fatering on DCT coeffidents. the encoding control 
data will enable the quantizer 307 and the variable- 
length coder 305 and win cause the input selector 3 1 5 to 

40 connect the partially-compressed modified bitstream 
122 from the decoded bitstream processor 118 to the 
input of the quantizer 307. The encoding control data 
w9l also deactivate the encoding nvsdules upstream of 
the eruxMfing module that receives the modified bit- 

45 stream, i.e.. the DCT module 309. the motion compen- 
sator 31 1. the spatial bitstream input module 313 and 
the kx:al decoder 317. Deactivating the unused encod- 
ing modules frees computational resources that would 
otherwise be used to provide these modules to t>e used 

50 for other purposes. 

It should be noted that when the compressed brt- 
stream processing apparatus according to the invention 
is embodied in a computer or digital signal processor, 
the conrtputer or digital signal processor may lack such 

55 elements as the input bus 138 and the encoder bit- 
stream parameter bus 140. In th^ case, the input selec- 
tor 315 may communicate the addresses at which the 
decoded bitstream processor 118 stored the modified 
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bitstream 122 to the first of the encoding modules to 
process the rrxxlified brtstream. This encoding module 
wiD then fetc^ the modified bttstream from these 
addresses. Similarty, the brtstream parameter tonvard- 
tng module 130 may connmunicata to the layered 5 
encoder 124 the addresses at which the bitstream 
parameters derived from the compressed input bit* 
stream 1 12 by the layered decoder 1 14 are stored. The 
layered encoder can then f^ch the bitstream parame- 
ters stored at these addresses to use them in connec- 10 
tion with encoding the modified bitstream. It should also 
be noted that, in computer-based and DSP-based 
ennbodiments, the encodng modules may t>e ephemr 
eral, and the apparatus will lack elements correspond- 
ing to the encoding modules that are not used to encode 15 
the modified bitstream 122. 

Some of the ways in which the bitstream parame- 
ters derived from the compressed input bitstream 112 
ty ttie layered decoder 1 14 can k>e used wiQ now be 
desabed. bri a first example, the bitstream parameters 20 
derived from the compressed input bitstream are for- 
warded to the decoded brtstream processor 118 where 
th^ are used to simpfify the processing performed t>y 
the decoded bitstream processor. The t)rtstream param- 
eters are color data indicating the color characteristics 2S 
of the video signal represented by the compressed input 
brtstreara Such color data are included in the picture 
headers derived from the compressed input bitstream 
by the denrultiplexer 203. The denuHiplexer tbmrards 
the cobr data to the decoded bitstream processor 118 30 
via the brtstream parameter fonMarding path 128. The 
decoded bitstream processa then uses the color data 
to determine whether it needs to apply cdor con-ection 
to the decoded bitstream 1 16. If the decoded bitstream 
processa determines that color correction is needed, it 3S 
may additionally use the color data to design an appro- 
priate color calibration scheme. 

The layered decoder 1 14 decodes the conrpressed 
input bitstream 1 12 to generate the decoded bitstream 
1 16 in a cornpression state suitable for processing by 40 
the decoded bitstream processor 118. The decoded bit- 
stream processor then applies color conedion to the 
decoded bitstream using the color calibration scheme it 
has derived from the color data derived from the conv 
pressed input bitstream. The layered encoder 124 then 46 
re-encodes the modified bitstream 122 generated by 
the decoded bitstream processor 1 18 to generate the 
compressed output brtstream 126. The video signal rep- 
resented by the compressed output t>itstream is color 
conrected relative to that represented by the con>- so 
pressed input bitstream. Additional bitstream parame- 
ters derived from the compressed input bitstream 112 
may be used by the layered erxxxler to simplify the 
encoding processing required to re-encode the modified 
bitstream 122, as will be descnbed below. ss 

As noted above, in conventionaJ MPEG conrpres* 
sion, the motion estimation operation of the encoding 
process requires the nrust conrputational resources. 


Motion estimation is conventionally perfonmed using a 
motion compensator module located in the encoder in a 
position correspondirrg to that of the nnotion compensa- 
tor 311 in the layered encoder 124. Consequently, elinr)- 
rnating or substantially simplifying the motion estimation 
operation can achieve substantial savings in the compu- 
tational resources required by the layered encoder 124. 

The motion compensator 311 can be compl^ety 
disabled if the decoded brtstream processor 1 18 can 
perform the processing operations selected by the user 
using the DCT coefficients derived from the com- 
pressed input bitstream 112 by the layered decoder 
1 14. TTus provides a sut>stantial reduction in the compu- 
tational resources demanded by the layered encoder. 
However, if the processing operation performed by the 
decoded bitstream processor 118 requires that the lay- 
ered decoder fully decode the compressed input bit- 
stream to provide a conventional video brtstream as the 
decoded bitstream 116, then the modified t)it5tream 122 
is a conventional video bitstream tfiat has to be fully re- 
encoded. 

The compressed bitstream processing apparatus 
100 provides a nunnber of ways of reducing tfie corrpu- 
tational resources required to re-encode the modified 
bitstream when the modified bitstream is a conventional 
video brtstream. The bitstream parameter forwarding 
path 128 fonvards the motion vectors derived from the 
compressed input brtstream 1 1 2 to the layered encoder 
124. The layered encoder can then use these motion 
vectors as the motion vectors in the motion compensa- 
tion operations performed by the motion compensator 
31 1 . This provides a signiftcant reduction in the conrpu- 
tational resources required by the layered encoder 124, 
since no motion estimation operations are performed. 
Re-using the motion vectors derived from the com- 
pressed input brtstream constrains the performance of 
the motion estimation in the layered encoder to be no 
better than that originally used to encode the com- 
pressed input bitstream. However, this is not usually a 
significant drawt>ack since most hardware or software 
encoders employ an effective although effidenl motion 
estimation algorithm. 

Simply re-using the motion vectors derived from the 
compressed input brtstream 11 2 will produce an accept- 
able motion estimation accuracy, but a better motion 
estimation accuracy is obtained by using the motion 
vectors derived from the conrpressed input bitstream as 
full-pixel motion vectors, and performing an addrtional 
half-pixel search relative to the full-pixel motion vectors 
to produce the final motion estimation. This alternative 
demands more computational resources than re-using 
the motion vectors derived from the original com- 
pressed input bitstreanrt However, it produces a better 
picture quality and a better connpression efficiency. 
Moreover, since the scope of the motion estimation 
search considerably less than that used in conven- 
tional motion estimation, the addrtional computing 
resources required are sitetantially less than those 
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required for conventional motion esb'matoa 

An example of the structure of the motion compen- 
sator 311 that performs local motion estimaton is 
shown in Rgure 4. The motion compensator inctudes 
the local motion essimator 441 and the sut>tractor 443. s 
The local motion estimator has Inputs connected to the 
outputs of the spatial bitstream input module 313. the 
encoder bitstream parameter bus 140. and the local 
decoder 317. The local motion estimator has outputs 
connected to the reconstructed picture memory 445 In io 
the local decoder, the erKoder bitstream parameter bus 
and both inputs of the subtracter 443. 

The local motion estimator 441 receives successive 
picture blocks from the spatial bitstream input module 
313 and performs a nration estimation operation on is 
each of them. The picture block that is the subject of the 
current motion estimation operation wflt be called the 
current picture block. The local motion estiniator also 
receives the motion vector for the current picture block 
from the encoder bitstream parameter bus 140. This 20 
motion vector was derived from the compressed input 
bitstream 1 12 as a bitstream parameter, artd was for- 
warded via the bitstream parameter tonararding path 1 28 
(Rgure 2). The local motion estimator derives an 
address from the fonwarded motion vector for ttie cur- 25 
rent picture block, and supplies this address to the pic- 
ture memory 445 of the local decoder 31 7. In response, 
the pictiffe memory feeds a super reference block back 
to the local motion estimator. The super reference block 
is a Uock of a reconstructed picture stored at the loca- 30 
tion in the picture memory designated by the address, 
and Is two pixels larger tftan a conventional picture block 
in both the horizontal and vertical directions. The larger 
size of the super reference block enables matching 
bk)cks having a hatf-pixel precision to be generated 3s 
from the super reference block. 

The local motion estimator 441 performs interpola- 
tion operations between adjacem pixel values in the 
super reference Uock to generate a set of eight 8x8 
pixel matching blocks. Each matching block is displaced 40 
relative to the center of the super matching ttodk in a 
different one of the directions N, NE, E. SE, S, SW, W. 
NW by a distance equivalent to one half of the distance 
between adjacent pixels in the super reference block. 
The local motion estimator also generates a ninth 4S 
matching Uock by selecting an 8 x 8 pixel pcture block- 
sized sutiset centered in the 10 x 10 pixel super refer- 
ence bkx:k. 

The local motion estimator 441 then performs a 
Uodc matching operation t>etween the current picture so 
block and the nine matcfiing blocks to determine which 
matching block most closely matches the current pic- 
ture block. This matching block wiU be called the closest 
matching block. The local motion estimator ttien adds 
the displacement of the dosest matching block relative ss 
to ttie fonftfaided motion vector to the fonvarded motion 
vector to generate a new motion vector with half-pixel 
precision for the cun^ent picture bkx:k. The local motion 
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estimator also adopts the closest matcfiing block as the 
reterer^ t)lock for the current fNCture block. 

The local mo/Hon estimator 441 feeds the hew 
rration vector with half-pixel precision to the encoder 
bitstream parameter bus 140 for fonwardirg to ttie 
encoder buffer 301. and feeds the cun-ent picture block 
and its reference block to the inputs of the subtractor 
443. The subtractor 443 perfonns a ptxel-by-pixel sub- 
traction of the reference tAock from the cunerrt picture 
block, and feeds the resulting difference tkxk to the 
DCT module 409. 

Bitstream parameters derived from the compressed 
input bitstream 112 may also be used to reduce the 
computational requb-ements of the bit rate control per- 
formed the layered encoder 124. Bit rate control 
ptays an important r6le in achieving good video quality 
and helps ensure ttiat the compressed output bitstream 
1 26 can be decoded in real time try a practical decoder. 
Bit rate control controls the number of bits aOocated to 
encode each pcture. The numt)er of bits allocated to 
encode each picture must not only quantize all ttie DCT 
ooeffidents in ttie picture witti a suffidern number of 
quantizrtg lerels to achieve an acceptable presOTtation 
quality, but must also satisfy ttie buffer overflow and 
underflow constraints defined by the MPEG standard. 

The compressed input bitstream 1 12 contains bit- 
stream parameters indicating the cfiaracteristics of 
each macrobk)ck. The layered decoder 114 can derive 
such bitstream parameters from ttie compressed input 
bitstream, and pass them to ttie layered encoder 124 
whe-e they are re-used to assist in performing the adap- 
tive bit allocation. Examples of two different approaches 
to re-allocating bits to the DCT coeff idents of each mac- 
roblock will be desait>ed with reference to Figures 3, 5 
and 6. 

In the first approach, illustrated in Rgure 5, the by- 
ered decoder 114 derives the quantizing step size 
'^mquanHM fro"i ttie compressed input bitstream 1 12. 
The quantizing step size 'nMOUANif^l ttie quantizing 
step size of ttie cunent maaobkxk in ttie compressed 
input bitstream. The layered decoder passes the quan- 
tizing step size to ttie layered encoder as a bitstream 
parameter. The quantizing step size is also passed to 
the inverse quantizer 207, which performs an inverse 
quantizing operation on ttie DCT coeffidents in ttie cur- 
rent macroblock k using ttiis quantizing step size. Then, 
in ttie layered encoder 124, the quantizer 307 calculates 
a new quantizing step size MQUANT[/4 for quantizing 
ttie DCT coeff k»ents of the current macroUock k and re- 
quantizes ttie DCT coeffidents of the cunent macrob- 
lock k witti the new quantizing step siza The quantizer 
calculates ttie new quantizing step size MQUANTf/c] 
using ttie quantizing step size for ttie current maaob- 
lock k fonAwded from ttie compressed input bitstream 

In ttie second approach, Qlustrated in Figure 6, ttie 
quantized DCT coeffidents for ttie aOTent macroblock k 
are derived from ttie compressed input bitstream by ttie 
inverse variable-length coder 205 and forwarded 
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through the bitstream pammsfter tbrwarding path 128 
from the layered decoder 114 to the quarrtizer 307 of the 
layered encoder 124. Also, the brtstream parameter 
mbincoefAf^l indicatir^ the number o! non-z&o OCT 
codfictents in the current tnacroUock is derived from 
the compressed input bilstream and fbnvarded from the 
lay^ed decoder to the quantizer in the layered encoder. 
Using the bitstream parameter mbirtcoed^]' ^ Quan- 
toer then performs an operation that nulls out selected 
ones of the non-zero quantized OCT co^idents such 
that the compressed output bitstream meets the above- 
mentioned kniffer constrains. 

Nulling out selected norvzero quantized OCT coef- 
f iciems cn tie second approach demands fewer compu- 
tational resources than the first approach because 
inverse quantizing and re^^uantizing are not performed. 
However, the first approach will usually provide a better 
presentation quality. 

The computational resources required by the first 
approach are reduced by using bitstream parameters 
derived from the compressed irput bitstream to enable 
the adaptive bit allocation of the compressed input bit- 
stream to assist in controlling the bit rate of the com- 
pressed output bitstream. The processing performed in 
the first approach is illustrated in Rgure 5. In the foDow- 
ing description, the Uock of DCT coefficients that is the 
subject of the cunent quantizing operation will be called 
the current block, and the picture of which the cunent 
block forms part will be called the current picture. 

At the start of encoding, steps S1 and S2 are per- 
formed. In step SI . the layered decoder 1 14 derives the 
tirtstream parameter from the compressed input bit- 
stream 1 1 2 and forwards this brtstream parameter to the 
quantizer 307 via the brtstream parameter fonvarding 
path 128. The bitstream parameter Rfj, indicates the bit 
rate of the compressed input bitstream. In step S2, the 
quantizer 307 in the layered encoder 124 receives the 
bitstream parameter from the encoder bitstream 
parameter bus 140, and receives the parameter R^^^ 
from the processing selection module 120. The quan- 
tizer then determines the ratio btts^o by dividing ffo^f 

In step S3, the inverse variable-length coder 203 
derives the bitstream parameter fn|^Qui^7{A(] from each 
macroblock in the compressed input bit stream 112. 
The brtstream parameter /WmquantN of the current 
maaoblock /c of the compressed input bitstream indi- 
cates the quantizing step size that was used to quantize 
the DCT coefficients of the cunent macroblock k. The 
inverse variable-length coder fonfvards the bitstream 
parameter /nMQUANT{^] ^ quantizer 307 in the lay- 
ered encoder 124. 

In step S4. the inverse variable-length coder 203 
derives the bitstream parameter inbitslk] for the cunent 
macroblock k by counting the number of bits in the com- 
pressed input bitstream used to represent the DCT 
coefficients of the cunent picture prior to the DCT coef- 
ficients of the current maaoblock k. The inverse varia- 


Ue^ength coder fonMords the bit^eam parameter 
inbi^lk] to the quantizer 307 in the layered encoder 

124; 

In steps S5-S8. the quantizer 307 in the layered 

s ertooder 1 24 uses tfie brtstream parameters forwarded 
by the layered decoder 114 to quantize the DCT ooefTi- 
dents in the cunent maaobtock witfi a quantizing step 
size that enables the bit rate of the compressed output 
bitstream 126 to comply with the above-mentionBd 

10 buffer constraints. The variable-length coder 305 
includes a counter that counts ou^tslk], the number of 
bits of the compressed output bitstream used to repre- 
sent the DCT coefficients of the current picture prior to 
the DCT coefftdents of the current macroblock k. The 

IS variaUe-length coder feeds each value of outbitslk] 
back to the quantizer. FinaDy, the quantizer receives 
ertcoding control data via the control path 142. 

In step S5. the quantizer determines the ratio 
bitSfstjoW ^ determining the ratio between outbits[k] 

20 and inbhslk], i.a: 

bits^^lk] = outbhslk\inbitslk] 

In step S6, the quantizer 307 determines the oorv 
25 version lector flk] for the current macroblock k. The 
quantizer calculates the conversion factor from the 
ratios bhs^lk] and bitSf^mgo using the followtng equa- 
tion: 


30 


2x bits ^ti^lk]^ bits „t^o 
' bits^tf^W-^Zxbrts^fyQ 


where 0.7 5^^1.3. 

35 In step S7. the quantizer 307 calculates the value of 
MQUAMTI/c] for the current macrdblock k. The value of 
MQUAMT^/c] is the quantizing step size that the quan- 
tizer will use to quantize the DCT ooeffidents of the cur- 
rent macroblock k. The quantizer calculates the value of 

40 MQUAMTI^] for the cun'ent macroblock k by nuittiplying 
the value of the l>rtstream parameter /nMouANil^l ^ 
conversion factor f[kl i.e.: 


MQUAlsfTIAf] = in,,aij^k] x /I^J- 


45 


In step S8, the quarYtizer 307 quantizes all the non- 
zero DCT coefficients in the currem macrobiock k using 
the quantizing step size MQUAhTTI/r]. 

In step S9. the quantizer determines whether all the 

50 macrot}Iocks in the current brtstream have been quan- 
tized. If so. proceiling proceeds to step S10, where it 
ends. Othenmse. processing returns to step S3 and the 
process of calculating the ratio brterafoM* the conver- 
sion factor flk] and the quantizing step size MQUANT]^] 

55 for the next macroblock k, and quantizing the DCT ooef- 
fidents of the next maaobk)ck using the quantizing step 
size MQUANTI^] is repeated urrtil the picture is con>- 
ptetely coded, and until the entire compressed input bit- 


13 


25 


EP0a89G50A2 


26 


stream has been processed. 

The oomputationa) resources required for the sec- 
ond approach are also reduced by using bitstream 
parameters derived from the compressed ir^ bit- 
stream to enable the adaptive bit allocation of the com- 
pressed input bitstream to assist tn controdlng the bit 
rate of the compressed output bitstream. The process- 
ing performed in the second approach is illustrated In 
Rgure 6. Steps SI. S2, S4-S6. and S9 are the same as 
in the first approach described above with reference to 
Rgure 5. and wiQ not be described again hera 

In step S3» the layered decoder 1 U derives the bit- 
stream parameter /n&inco«#] each macrcblocK of the 
compressed input bitstraam 1 12 and forwards this bit- 
stream parameter to the quantizer 307 in the layered 
encoder 124 via the bitstream parameter fonArarding 
path 128. The bitstream parameter mbi„ooed^] 
cates the number of non-zero DCT coefficients in the 
current macroblock of the oorrpressed input bit- 
stream. 

In step S5A, the layered decoder 1 14 forwards the 
quantized DCT coefficients derived from the com- 
pressed iriput bitstream 112 by the inverse variable- 
length coder 205 to the quantizer 307 via the bitstream 
parameter forwarding path 128. 

In step S7, the quantizer 307 in the layered encoder 
124 uses the bitstream parameter m^moe^t^] ^ 
mine the number of the quantized DCT coefficients 
received from the layered decoder that wiD be set to 
zero to control the bit rate of the compressed output bit- 
stream. The quantizer calculates the value of 
fnboufco^k] for the current macroblock k. The value of 
mbotjtcoed^] ^ ^0 mjmber of DCT coefficients in the 
macroblock k that may have a value other than zero. To 
calculate the value of mboutco^^] the current mac- 
roblock k, the quantizer multiplies the value of the bit- 
stream parameter mbmcxfoAk] by the value of the 
conversion factor f[k] calculated in step S6, i.e., 

In step 86. the quantizer 307 receives an the quan- 
tized DCT coefficients of the cun-ent macroblock k from 
the inverse variable-length coder 205. and sets to zero 
alt but the nunnber of tftem indicated t)y the value of 

In the embodiment just described, the compressed 
input signal and the compressed output signal were 
both MPEG-oonpliant bitstreams. An example of a sec- 
ond emtxdiment 700 of a compressed bitstraam 
processing apparatus according to the invention wilt 
now be described with reference to Rgures 7A and 7B. 
This embodmnent operates on a compressed input bit- 
stream In any compression state, generates the com- 
pressed output bitstream in arry compression state, end 
allc^ multiple processors operating on bitstreams hav- 
ing different corrpression states to be concatenated. In 
the example to be descrS>ed. the compressed bitstream 


processing apparatus processes a corrpressed input 
bitstream representing a video signal. 

The compressed bitstream processing apparatus 
700 is composed of four basic units, the first compres- 

5 sion state translation unit 714. the final compression 
state translation unit 724. the processor 71 8A. and the 
bitstream parameter fonArarding path 728 that includes 
the bitstream parameter fonwarding module 730. tf the 
compressed bitstream processing apparatus is 

10 designed to allow a user to select or d^ine the process- 
ing operation performed, the apparatus additionally 
includes the processing selection module 720 that 
receives instructions from the user and controls the 
processing performed by the compression state transla- 

15 tion units and the processa. Othenwise, the processing 
selection module controls the processing performed by 
the compression state translation units and the proces- 
sor so that the compressed txtstream processing appa- 
ratus performs a predetermined processing operation 

20 on the confessed input bitstream. 

The example sfwwn in figure 7A includes two 
optional additional units, the compression state transla- 
tion unit 71 4B and the second processor 71 SB. These 
additional units provide the corrpressed bitstream 

25 apparatus 700 with the capability to process the infor- 
mation signal represented by the compressed input bit- 
stream in two different ways, a first way performed by 
the first processor 718A and a second way performed 
by the processor 71 86. The compression state transta- 

30 tion unit 71 4B precedes the optional second processor 
718B, and the two units are interposed t>etween the first 
processor 71 6A and the f inal compression state transla- 
tion unit 724. The compression state translation unit 
7148 and the second processor are also connected to 

36 the bitstream parameter forwarding path 728 and are 
controlled by the processing selection unit 720. 

Prececfing the second processor 7188 with the 
compression state translation unit 7148 enat)les the 
second processor to operate on a bitstream having a 

40 different corrpression state from the bitstream output by 
the first processor 71 8A. Optionally, more than one 
additional processor, each preceded t>y a compression 
state translation unit may be interposed between the 
first processor 718A and the final compression state 

45 translation unit 724. 

In ttie exarrple shown in figure 7A, the video signal 
represented by the compressed input bitstream 712 is 
subject to two different processing operations, one per- 
formed by the first processor 71 8A and the other per- 

50 formed by the second processor 7188. The first 
processor is preceded by the compression state trans- 
lation unit 71 4A. which chariges the corrpression state 
of the corrpressed input bitstream to generate the out- 
put bitstream 71 6A in the compression state required biy 

55 the first processor. The first corrpression state transla- 
tion unit enables the compressed input bitstream 712 to 
have a compression state that differs from that required 
by the first processor. 
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The first processa 71 8A processes the cxjtput brt- 
stream 71 6A generated by the compression stale trans- 
lation unit 714A to generate the modified bitstream 
722A. The first processor modifies the video signal rep- 
resented by the output bitstream 716A. but does not $ 
change the compression state of the output bitstream. 
Consequently, the compresston state of the modfied 
bitstream 722A is the same as that of the output bit- 
stream 71 6A. Optionally, the first processor 714A may 
be composed of muit9)le concatenated processors, al) ro 
of which operate on bitstreams in the same compres- 
sion state. 

The second processor 718B is preceded by the 
compression state translation unit 7146, which changes 
the conpression state of the modified bitstream 722A to is 
generate the output bitstream 71 6B in the compression 
state required by the second processor. The oonpres- 
eton state translation unit 714B enables the second 
processa to be concatenated with the first processor 
718A, even though the processors operate on input bit- 20 
streams having differing conpression states 

The second processor 7188 processes the output 
bitstream 7168 generated by the compression state 
translation unit 71 4B to ger^erate the modified bitstream 
722B. The second processor modifies the video signal 2S 
represented by the output bitstream 71 68. but does not 
change the compression state of the output brtstreami 
Consequently, the compression state of the mocfified 
bitstream 7228 is the same as that of the output bit- 
stream 716B. Optionally, the second processor may so 
also be composed of multiple concatenated processors, 
all of which operate on t>it5treams in the same oorrpres- 
sion state. 

The second processor 7188 is followed by the final 
compression state translation unit 724, which charges 3s 
the compression state of the modified bitstream 7228 to 
generate the compressed output signal 726. This ena- 
bles the compressed t>{tstream processing apparatus 
700 to deliver the compressed output signal in the 
desired oorrpression state. The final corrpression state 40 
translation unit may also change the bitstream charac- 
teristics, ag.. bit rate, buffer size. etc.. of the modified 
bitstream to generate the compressed output bitstream 
with the desired bitstream characteristics. The com- 
pressbn state and bitstream characteristics of the com- 45 
pressed output signal may be the same as. or different 
from, that of the compressed input bitstream 71 2. 

Figure 78 shows details of the compression state 
translation unit 714 having the same structure arxl oper- 
ation as the compression state translation units 71 4A, so 
7148 and 724 of the embodiment shown in Figure 7A. 
The compression state translation mit 714 receives the 
input bitstream 712 in a first compression state, selec- 
tively changes the compression state of the input bit- 
stream to generate the output t^tstream 716 having a ss 
different compression state from the input bitstream. 
The compression state of the output bitstream may be 
greater than a less than that of the input bitstream. i.a. 
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the compression state translation unit 714 may operate 
in an encoding mode or a decoding mode; depending 
on the control data received via the control path 732. 

The compresston state trarrslation unit 714 is com- 
posed of three main modules, the input interface 719. 
the output intertace 721, and the layered encod- 
ingAlecoding modules 723. The layered encod- 
ing/decoding modules are composed of an 
encoding/decoding module corresponding to each con>- 
pression state of the compressed input bitstream. In the 
exanple shcwvn. the layered encodng modules are the 
variable length coding/decoding module 705, the quar>- 
tizing/inverse quantizing module 707. the orthogonal 
transform module 7D9 and the motion compensa- 
tion/spatial processing module 71 1 . 

The input interface module 719 includes buffering 
and demuttiptexing elements (not shown) that derive tnt- 
stream pararr^ers from the input bitstream 712. The 
input imerface module selectively feeds the bitstream 
parameters to those of the layered encoding/decoding 
modules 723 that require them via the input k>us 738. 
The input bus enables the input interiSace module to feed 
bitstream parameters to any of the encoding/decoding 
modules. The control data received via the control path 
732 determine which of the er^cocfing/decoding mod- 
ules receive the bitstream parameters from the input 
bus. 

The input Interface module 719 also feeds the bit- 
stream parameters to the bitstream parameter fonward- 
ing bus 736 tor forwarding to the processors 718A and 
7168 and to other compression state translation units 
via the bitstream parameter fonvarding path 728. The 
control data received via the control path 732 determine 
which of the bitstream parameters are fed to the bit- 
stream parameter font^ing bus 736. 

The bitstreanrs generated by the layered encod- 
ing/decoding nxxiules 723 are fed to the data output 
bus 725. These tNtstrearre are conposed of such data 
elements as pixel values, motion vectors, coded, quan- 
tized OCT coefficients, etc. The data output bus trans- 
fers these bitstreams to an encoding^decoding module 
of a higher or tower layer, arxl also to the output inter- 
face module 721. 

The output interface module 721 includes multiplex- 
ing and buffering elements (not shown) that constnict 
the output bitstream 71 6 from the tMtstreams generated 
by one or more of the layered encocfing/deooding mod- 
ules 723. The output interface nxxtule can select the bit- 
stream output by any of the encoding/decoding 
modules for inclusion in the output bitstream. The out- 
put interlace module selects the encoding/decoding 
modjles from to receive a bitstream for inclusion in the 
output bitstream in response to the control data 
received via the control path 732. 

The layered encoding/decoding modules 723 are 
all dual-function modules. Each of the modules is capa- 
ble of operating in an encocfing mode v in a decoding 
mode, depending on the control data received via the 
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control path 732. For example, when the control data 
set the orthogonal transfonn module 709 to rts encoding 
mode, this module performs both fonvard and re/erse 
disaete cosine transfomG. the inverse transforms 
being required to pro^e part of tfie local decoding 5 
function of an encoder. When the control data set the 
orthogonal trartsform module to Hs decoding mode, this 
module only performs Inverse disaete cosine trans- 
fornw. 

The control data received via the control path 732 10 
also select the encoding/decocfing modules required to 
provide the conpression state translation unit with its 
desired compression state translation characteristic. 
The control data may select all of the encoding^deood- 
ing modules, or a subset of the encocfingAlecocfing is 
OKXluIes, depending on the conpression states of the 
irpul and output bitstreams. 

In a oonrputer- or DSP-based compressed bit- 
stream processing apparatus, the control data received 
via the control path 732 also determine the allocation of 20 
computational resources to each of the layered encod- 
ing/decoding modules 723. The compression state 
translation unit performs a partial encoding or decoding 
operation using a sut>set of the layered encod- 
ing/decoding modules. Normally, in this case, no oonv zs 
putational resources are allocated to the remaining, 
unused encoding^decoding modules. 

Each of the encodingtiecoding modules 723 oper- 
ates on a bitstream output by eitfter the input interface 
module 71 9 or the encodingAdecoding module in at least 30 
one high^ or lower processing layer. Each of the 
encodng/decoding modules outputs a bitstream to the 
output interface ntodule 721 or to the encoding/decod- 
ing module in at least one higher or lower processing 
layer. The bitstream routing amovg the enood- 3s 
fng/deooding modules and t)etween the input and out- 
put interface modules 719 and 721 and the 
encodng/deooding modules is determined t^y the con- 
trol data received via the control path 732. Whether a 
bitstream is output to a encoding/decoding nxxlule in a 4q 
higher layer or a lower layer depends on whether the 
compression state translation unit is operating in its 
erYcode nwde or its decode mode, respectively. 

In addition, the layered encodirig/decoding modules 
723 may operate using bitstream parameters recdved 45 
via the bitstream parameter forwarding path 728. and 
the layered encocfing/decoding modules may addition- 
ally or alternatively derive bitstream parameters from 
the compressed input bitstream and fonvard such bit- 
stream parameters to the other compression state so 
translation units and the processors via the bitstream 
parameter forwarding path 728. 

A first practical example of a compression state 
translation unit will rx>w be described. In this example, 
the compression state translation unit is the first conv 55 
pression stale translation unit 714A of a compressed 
bitstream processing apparatus in which the first proc- 
essor 71 8A operates on a partially-compressed bit- 


stream composed of OCT coefficients. In this exanple. 
the input bitstream 712 of the first compression state 
translation unit is an MPEG bitstream. and the first oonrh 
presGion state translation unit operates to decode the 
MPEG bitstream to the compression state required by 
the first processor. 

Control data received via the control path 732 
cause the conpression ^te translation unit 71 4A to 
operate in the follwing way: the variable-length ood- 
ingAJecoding nfKXlule 705 operates in rts variable^ength 
decoding mode, the quantizing/inverse quantizing mod- 
ule 707 operates in its inverse quantizing mode and the 
remaining encodingAdecoding modules are disabled. No 
computational resources are allocated to the disabled 
encodingAdecoding modules. 

The input interface module 719 derives coded, 
quantized DOT coefficients, quantizing tables, motion 
vectors, picture headers and other bitstream parame- 
ters from the input bitstream 712. U^ng the input bus 
738, the input interface module feeds the OCT coeffi- 
cients to the variable-length decoding module 705, the 
quantizing tables to the inverse quantizing nradule 707, 
and the motion vectors and picture headm to the out- 
put interface nrxxJule 721. Using ttie bitstream parame- 
ter fonwarding bus 736. the input inteitace module also 
feeds the quantizing tables, motion vectors, picture 
headers and other bitstream parameters derived from 
the input bitstream to the bitstream parameter forward- 
ing path 728 and to the output interface module 721. 

The output interface module 721 receives via the 
output bus 725 the bitstream of OCT coelf idents output 
by tile inverse quantizing nxxiule 707. The output inter- 
face module receives via the forwarded bitstream 
parameter bus 736 a bitstream conposed of tfie 
respective picture headers and motion vectors from the 
input interface module 719. The output interface nxxiule 
forms the output bitstream 716 from the OCT coeffi- 
dents and the respective picture headers and motion 
vectors. 

The bitstream paranrreters derived from the input 
bitstream 712 by the first conpression state translation 
unit 71 4A are forwarded via the bitstream fonvarding 
path 728 to the first and second processors 718A and 
7188 for use in processing the output bitstream gener- 
ated by the compression state translation unit 714A. 
The t>rtstream parameters are also fonwarded via the bit- 
stream fonwarding path 728 to the compression state 
translation units 71 4B and 724 for possft)le use in re- 
encoding the modjfied bitstreams generated by the first 
and second processors. 

A seoorxi practical example of a compression state 
translation unit will now be descrbed. In this ocanple. 
the compression state translation unit is again the first 
conpression state translation unit 71 4A of a com- 
pressed bitstream processing apparatus 700 in which 
the first processor 71 8A operates on a partiaily-oom- 
pressed bitstream conposed of DCT coeff idents. In this 
second example, the Input bitstream 712 is a partially 
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compressed brtstream composed of f^ctures in coding 
order, and in which each picture is composed o1 a set of 
encocfing blocks. Encoding blocte are picture blocks 
composed of a pixel value for each pixel when the pic- 
ture is a l-picture. and are difference btocte connposed 
of a difference value for each pixel wften the picture is a 
P- or B-pcture. In the latter case, each encoding btock 
has a respective motion vector. The compression state 
translation unit operates 71 4A to encode the partiafly- 
compressed input bitstream to change the compression 
state of the input bitstream to that required by the fir^ 
processor. 

Control data received via the oontrd path 732 
cause the compression state translaton unit 71 4A to 
operate in the following way: the ortfiogonal transform 
module 709 operates in its fbnMard transform mode, and 
the remaining encodingAfecodng modules are disa- 
bled. No oon\putational resources are allocated to the 
disabled encoding/decodng modules. 

The input interface module 719 derives the encod- 
ing blocks, motion vectors and other brtstream parame- 
ters from the irtput bitstream. Using the input bus 725, 
the input irrtertace module feeds the encoding blocks to 
the orthogonal transform module 709. The input inter- 
face module also feeds the oration vectors ar^ other bit- 
stream parameters derived from the input bitstream to 
the bitstream parameter fonRfarding bus 736 for fonftraid- 
ing to the bitstream parameter fonnarding path 728 and 
to the output interface module 721. 

The output interlace module 721 receives via the 
output bus 725 the bitstream of DOT coefficients output 
by the orthogonal transform nnodule 709. The output 
interface module also receives via the brtstream param- 
eter forwarding bus a bitstream composed of the 
respective motion vectors for the DOT coefficients from 
the input interface ntodule 719. The output internee 
module fonns the output bitstream 716 from the OCT 
coefficients and respective motion vectors. 

Again, the bitstream parameters derived from the 
input brtstream 71 2 by the first compression state trans- 
lation unit 71 4A are fonvarded via the brtstream fonward- 
ing path 728 to the first and second processors 718A 
and 71BB for use in processing the output t^itstream 
generated by the compression state translation unit 
714A The bitstream parameters are also fonvarded via 
the brtstream fonwarding path 728 to the compression 
state translation units 71 4B and 724 tor possible use In 
further changing the compression state of the modified 
bitstreans generated by the first and second proces- 
sors. 

In both examples just described, fonRfarding the bit- 
stream parameters from the first connpresston state 
translation unit 714A saves the conpression state 
translation units 71 4B arul 724 from expending oonrpu- 
tational resources to generate new parameters equiva- 
lent to the t)rtstream parameters fonwarded by the 
compression state transtaton unit 714A. Consequently, 
the compressed bitstream processing apparatus 700 


according to the invention can perform the desired 
processing of the compressed input bitstream using a 
smaller scale of hardware or a less powerful computer 
or digital signal processor than a conventional oonv 

5 pressed information signal processing apparatus Alter- 
natively, compared with a conventional processing 
apparatus, the compressed bitstream processing appa- 
ratus 700 can perform the desired processing at a faster 
rate, e.g.. faster than real-tinte, using given hardware or 

ro a given computer. 

Although this disclosure describes illustrative 
embodim^ of the invention in detail, it is to be under- 
stood that the invention is not limited to the precise 
embodiments desaibed, and that various modifications 

IS may be practiced within the scope of the invernion 
defined by the appertded claims. 

Ctafms 

20 1 . Apparatus (1 00, 700) for processong a compressed 
input brtstream represerrting on information signal, 
the apparatus comprising: 

a layered decoder (114; 714) that decodes the 
2S compressed irput bitstream (1 12, 712) to pro- 

vide a decoded bitstream (116. 716A). the lay- 
ered decoder including serially-connected 
decoding modules (e.g., 201, 203, 705. 707), 
each having an output; 
30 a decoded bitstream processor (118, 718A] 

that processes the decoded brtstream in a way 
that modifies the information signal to provide a 
modified bitstream (122, 722A). the decoded 
bitstream processor having an input and an 
35 output; 

a layered encoder (124, 724) that re-encodes 
the modified bitstream to provide a com- 
pressed output brtstream (126, 726). the lay- 
ered encoder including serially-connected 
40 enooding nrKidules (ag.. 301, 303; 705, 707). 

each of the enooding modules having an input, 
each of the encoding modules corresponding 
to one of the decoding modules of the layered 
decoder; and 

45 a selective interconnection path (134, 215, 

315, 138; 725. 721, 719. 738) that selectively 
connects the output of one of the decoding 
modules to the input of the decoded bitstream 
processor and that selectivefy connects the 
so output of the decoded bitstream processor to 

the input of one of the encoding modules, the 
one of the encoding modules corresponding to 
the one of the decoding nvxlules. 

55 2. The apparatus of claim 1, additionally comprising 
means (120, 132, 142; 720, 732) for deactivaling 
the decoding modules dcwnstream of the one of 
the decoding modules, and for deactivating the 
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encoding modules tpstream of the one ol the 
encoding modules. 

3. The apparatus of claim 1 or 2. in which: 

the layered decoder includes deriving means 
(e.g., 203; 712) for denying bitstream parame- 
ters from the compressed input brtsfream; 
the apparatus additionally comprises a kut- 
stream paran^er fonwarcGng path (128. 728) 
that interconnects the layered decoder to the 
layered encoder; and 

at least one of the encoding modules is con- 
nected to the parameter fonwanding path and 
performs an encoding operation using the bit- 
stream parameters derived from the com- 
pressed input bitstream by the deriving rroans. 


the layered encoder re-uses the bitsb-eam 
parameters to re-encode the modified bit- 
stream. 

5 7. The apparatus of claim 6, in which: 


the decoded bitstream processor is addrtionalty 
connected to the bitstream parameter fomvard- 
ing path (128. 728); and 
the decoded bitstream processor processes 
the decoded bitstream in resportse to the bit- 
stream parameters derived from the com- 
pressed, input bftstream by the deriving means. 
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A method for processing a compressed input bh- 
stream representing an information signal, the 
method comprising: 


4. Apparatus (100, 700) for motfifying txtstream char- 
acteristics of a compressed input bitstream repre- 20 
senting an tnfomiation signa). the apparatus 
comprising: 

a corrtroller (120. 720) that provides an output 
bitstream definition doming bftstream charac- 2s 
teristics of a compressed output bitstream; 
a layered decoder (114. 71 4A) tfwt decodes 
the compressed input bftstream (112. 712) to 
provide a decoded bitstream (1 16. 716A). the 
layered erMxsder including deriving means so 
(e.g.. 203, 719) for deriving bitstream parame- 
ters from the compressed input bitstream; 
a bitstream parameter fonwarding path (128. 
728) connected to receive the bitstream 
parameters from the layered decoder ; 35 
a layered encoder (124. 724) connected to the 
bitstream parameter fonvarding path and that 
re-uses the bitstream parameters derived from 
the compressed input bftstream by the deriving 
means to re-encode the decoded bftstream in 40 
accordance with the output bftstream definition 
to prwtde the compressed output bitstream. 

& The apparatus of daim 4. in which the decoded tit- 
stream is partially encoded relative to the informa- 45 
tion signal 

6. The apparatus of daim 4 or 5. in which: 

the apparatus additionally comprises a so 
decoded bitstream processor (118. 718A) con- 
nected to receive the decoded bitstream (1 16, 
716) and to provide a modified titstream (122. 
722A) to the layered encoder in lieu of the 
decoded bftstream (1 16. 716). the decoded bit- ss 
stream processor processing the decoded bit- 
stream in a way that modrfles the information 
signal; and 


partially deoodng the compressed input bit- 
stream (112) to provide a decoded bitstream 
(1 16). the decoded bitstream being a partially- 
enooded bitstream representing the infoma- 
tion signal; 

generating a modified bitstream (122) by 
processing the decoded bitstream in a way that 
modifies the information signal, the modified 
bitstream being a partially-encoded bitstream; 
and 

re-encocfing the modified bitstream (122) to 
generate a compressed output txtstream (1 26). 

9. The method of daim 8. in which: 

the method additionally comprises deriving bit- 
stream parameters from the compressed input 
bitstream; and 

the modified bitstream (122) is re-encoded 
using the bitstream parameters derived from 
the compressed input bitstream. 

10. A method for modifying the bitstream characteris- 
tics of a compressed input bitstream representing 
an information signal, the method comprising: 

generating an ou^ bitstream definition defin- 
ing bitstream characteristics of a compressed 
output bitstream: 

deriving bitstream parameters from the com- 
pressed input bitstream (1 12); 
at least partially decoding the compressed 
input tMtstream to provide a decoded bftstream 
(116); and 

re-encoding the decoded bitstream using the 
bitstream parameters derived from the com- 
pressed input bitstream to generate the com- 
pressed output bitstream (126) having the 
bitstream characteristics defined by the output 
bitstream definition. 
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11. The method of daim 10, in which the titstream 
paramet^ derived from the compressed input bit- 
stream are txtstream parameters gmeratBd using 
large computationa) resources. 

12. The method d daim 10 or 11, in which: 

the method additional^ comprises processing 
the decoded txtstream (116) to generate a 
modified bitstream (122), the decoded bit- 
stream being processed in a way that modifies 
the information signal; and 
the modified bitstream is re-encoded in lieu of 
the decoded fc>itstream. to- generate the com- 
pressed output bitstream, the modified txt- 
stream being re-ertcoded using the bitstream 
parametera 

IX The method of daim 10, 11 or 12. in which the 
decoded bitstream is processed in response to the 
bitstream parameters. 


14. Apparatus (700) for processing a compressed input 
txtstream representing an information signal, the 
compressed input bitstream having a compression 2s 
state, the apparatus compristng: 


a first compression state translation unit (71 4A) 
that receives the compressed input bitstream 
(712) as an input bitstream and changes the 
compression state of the compressed input txt- 
stream to generate an output txt^eam [71 6A); 
a processor (7iaA) that receives the output txt- 
stream of the first compression state trar^- 
tion unit, processes the output txtstream in a 
way that modifies the information signal, and 
provides a modified bitstream; artd 
a second compression state translation unit 
(724) that receives the modified bitstream as 
an input bitstream and changes the compres- 
sion state of the modified bitstream to generate 
an output txtstream (726), the first and second 
compression state translation units 
irtduding: 


layered encodingAdeooding modules (e.g., 
705. 707, 709. 711). each having an input 
and an output 

an input interface module (719) that selec- 
tivety connects the input bitstream to one 
of the encoding/decocfing modules, the 
one of the encoding/decoding modules 
depending on the compression state of the 
input bitstream, and 

an output interface nrKKfule (721) that 
selectively receives a bttstream from the 
output of one of the encodingAiecoding 
modules as the output bitstream. the one 


36 

of the encodngAfeooding modules 
depending on the compression state of the 
output txtstream. 


5 i& The apparatus of daim 14. oldrtionaUy comprising 
means for deactivating ones of the enood- 
ingAjecot£ng modules not required to change the 
compression state of tfie input bitstream. 

10 16. TheapparatusofdaimUorlS, inwtiich: 


the first compression state trardation unit 
tndudes means tor deriving . bitstream parame- 
ters from the input bitstream; 
the apparatus additionally comprises a param- 
eter fonMarding path (728) that interoonnecls 
the first compression state translation unit and 
the second compression state translation unit; 
and 

at least one of the encoding/decoding modules 
of the second compression state translation 
unit is connected to the parameter forwarding 
path and performs an encoding operation using 
the bitstream parameters derived from the 
compressed input bitstream. 
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17. A method for processing a compressed input bit- 
stream represeriting an information signal, the com- 
pressed input bitstream (712) having a 
compression state, the method comprising: 

providing layered encoding/decoding modules 
(ag., 705, 707. 709.711); 
selecting a first at of encotfing/decoding mod- 
ules and a second set of encoding/decoding . 
modules from the layered encoding modules; 
changing the compression state of the com- 
pressed input bitstream (712) using the first set 
of enooding^decoding modules to provide a first 
output bitstream (71 6A); 
processing the first output bitstream to gener- 
ate a modified txtstream (722A), the first output 
bitstream being processed by in a way that 
modifies the information signal txit generates 
the modified txtstream in the same compres- 
sion state as the first output bitstream; and 
changing the compression state of the modified 
bitstream using the second set of encod- 
ing^decoding ntodules to generate a second 
output bitstream (e.g., 716B, 726). 

1& The method of daim 1 7, additionally comprising: 

selecting one of an encoding mode and a 
decoding mo6o for the encoding/decoding 
modules of the first set; and 
selecting one of an erwoding mode artd a 
decoding mode for encodingAiecoding mod- 
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utes of the second at 

19. The method of datm 17 or 18, tn vtrhich: 

the method eddhionaDy conrtprcses deriving bit- s 
stream parameteis from the compressed input 
brtstream; and 

the compression state of the modified bit- 
stream is changed using the bitstream parame- 
ters derived from the compressed input w 
t)itstream. 

20. The method of daim 17, 18 or 19. in which: 

the method addrtiorudty oomprtses deriving bit- is 
stream parameters from the compressed Input 
bitEtream; and 

the first output bitstream is processed using the 
bitstream parameters derived fn>m the conv 
pressed input bitstream. 20 
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